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Abstract 

The inner silicon detector of the Compact Muon Solenoid experiment (CMS) at CERN's LHC consists of 
16 588 modules. Charged-particle tracks in the detector are used to improve the accuracy to which the 
position and orientation of the modules is known. This contribution focuses on the Millepede-II algorithm, 
one of the two alignment algorithms used by CMS. Recently an advanced track model has been introduced 
into the CMS alignment procedure, which is based on the "Broken Lines" model and is able to take multiple 
Coulomb scattering in the detector material properly into account. We show the unique approach needed 
for solving the alignment problem in a reasonable amount of time. Emphasis is given to the mathematical 
treatment of the problem. 
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1. Introduction 

The inner tracker of the CMS pQ detector at 
CERN's Large Hadron Collider (LHC) is designed 
to track the paths of charged particles as they 
pass through the detector. In order to determine 
the parameters of such tracks accurately, the posi- 
tions and orientations of the detector modules need 
to be known to at least their intrinsic resolution 
(« 10 /im). 

Track-based alignment. Track-based alignment is a 
least squares minimization problem (\ 2 minimiza- 
tion). The one or more dimensional residuals, r^-, 
for a given hit i on a given track j represent the 
distance between the hit location predicted by the 
track model (helix or other suitable model) and the 
actual hit measurements from the detector mod- 
ules, calculated using the knowledge of the geom- 
etry before the alignment. Using the covariance 
matrix Vjj of each measurement, the global y 2 is 
calculated as: 
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x 2 (p,q)= ^^'(P'^') v i/ r >i(p,qj) (!) 

j i 

and minimized with respect to the alignment pa- 
rameters p and the track parameters q of all tracks. 
Millions of tracks are required for accurate param- 
eter determination. As the effects of multiple scat- 
tering in the detector material can be significant in 
comparison with the intrinsic measurement resolu- 
tion, they have to be described properly. 

2. Millepede-II 

Track-based alignment with the Millepede-II al- 
gorithm [5] uses a simultaneous fit of a large num- 
ber of tracks to determine corrections Ap to the 
positions and orientations of the detector compo- 
nents. It assumes independent and uncorrelated 
scalar measurements to™ with errors o~ij. Using 
block-matrix theorems the alignment problem can 
be reduced (without approximations) to a matrix 
equation A a ii gn Ap = b a iign of the size of the num- 
ber of alignment parameters rt a ii gn . This reduction 
requires the covariance matrices of all individual 
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track fits to construct A a i; gn . The track model 
Tfiij = fij(p,<lj) is linearized at some starting val- 
ues of the alignment and track parameters: 



ry = rnij - /y(p , q j0 ) - -^-Ap - -^-Acfc 

tracks meas. 2 

X 2 (Ap,Aq)= £ E 4 (2) 



Linearization and outlier downweighting or rejec- 
tion require an iterative procedure. To setup the 
matrix equation of alignment parameters and up- 
date it during iterations, for each track a fit is per- 
formed to determine with the current values of the 
alignment parameters p = po + Ap the residuals 
Tij and at least in the first iteration the covari- 
ance matrix V(qj) of all track parameters along 
the trajectory. Constraints from the physical struc- 
ture of the problem are treated via Lagrange mul- 
tipliers. The matrix A a ij gn is usually sparse (not 
all detector components are connected by tracks). 
The equation system can be solved with different 
methods. With simple matrix inversion the so- 
lution is Ap = A~ lign baii gn . The calculation of 
A-aUgn is done once in the first iteration. As inver- 
sion requires 0(n align ) operations and the storage 
of the full matrix this method is slow and mem- 
ory consuming, but provides the covariance ma- 
trix of the solution. With typical computing re- 
sources the practical limit for matrix inversion is at 
^aiign of a few 10 4 . Alternatively the fast iterative 
MINRES algorithm [3] can be used. It minimizes 
||A a ii gn Ap — b a i ign || 2 with n;t internal iterations us- 
ing 0(^align n it) operations. It needs only the sparse 
representation (the non zero elements) of the ma- 
trix saving a large fraction of memory space. 

In the technical implementation Millepede-II is 
split into two parts: The first (Mille) is integrated 
in the track reconstruction software and writes for 
each track a record to a special binary file. A 
record contains for all measurements of that track 
the residuum, its error and the non-zero deriva- 
tives versus the alignment and track parameters. 
The second (Pede) is a standalone program imple- 
mented in FORTRAN reading the binary files and 
performing the solution according to the specified 
steering. 



3. Broken lines 

Charged particles traversing layers of mate- 
rial experience multiple scattering, mainly due to 
Coulomb interaction with the electrons in the 
atoms, resulting in random changes in direction and 
spatial position with expectation values of zero and 
variance depending on the traversed material and 
the particle momentum. The broken lines model 
is a track refit adding the description of multiple 
scattering to an initial trajectory and able to deter- 
mine the covariance matrix of all track parameters. 
Therefore it is well suited as track fit for Millepede- 
II. The original formulation [3] describes the case of 
a tracking detector with a solenoidal magnetic field 
and independent two dimensional tracking in the 
bending and perpendicular to the bending plane. 
It constructs the planar trajectories from the mea- 
surements including the material around those as 
thick scatterers. 

In the presence of measurements with compo- 
nents in both planes a single trajectory in space 
is required. In the following this is described for 
a track with n meas one- or two- dimensional mea- 
surements in n p i ane planes. The material between 
adjacent measurements planes is represented by up 
to two thin scatterers (zero thickness) with the 
same mean and variance of the material distribu- 
tion. A thin scatterer produces no direct spatial 
shifts but only a two dimensional scattering angle 
with a variance = $0(01) ■ The trajectory 
is constructed now from the thin scatterers adding 
the measurements by interpolation of the enclos- 
ing scatterers. At each thin scatterer a two dimen- 
sional offset u = (xj_,yj_) in the curvilinear frame 
(perpendicular to the track direction) is defined as 
fit parameter of the track together with a common 
curvature correction Ak. To define the start and 
end of the trajectory the first and last measurement 
planes are added to the sequence of scatterers. The 
number of scatterers n scat is between two (no ma- 
terial at all) and 2rc p i anc (thick scatterers between 
all planes) and the number of track parameters to 
be fitted is n par = 2n scat -I- 1. Figure [T] illustrates 
this construction. 

With small distortions Au of the offset, Act of 
the slope and Ak of the curvature as local track 
parameters the offsets propagate like: 

Au i+1 = — Aui + — Aa, + — — Ak 

OVLi Odi OK 

= JiAui + S t Aa t + diA« (3) 
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In case of a measurement instead of a scatterer at 
Uo there is no scattering angle and solving the pre- 
vious equation for u; nt = Uo with P = using 
N = (W + J + + W_J_) _1 results in the interpo- 
lation equation: 



• prediction ui Uint,2 Uimj u„, c „ 
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Figure 1: Simple example in one plane, no curvature correc- 
tion Are, measurements rrii in planes perpendicular to the 
track direction and homogeneous material distribution. Top: 
Residuals versus initial trajectory along arc-length s. Bot- 
tom: Broken lines trajectory based on thin scatterers with 
offsets u. The material between measurement i and i + 1 is 
described with two thin scatterers at s = (sj-|_x+Si)i(sj-|_i — 
s;)/\/l2. First and last measurement define additional off- 
sets. The fit prediction Ui n t,i for the measurement rrt; is 
obtained by interpolation between the enclosing scatterers: 

«int,« = f(u2i-l,U 2 i), («int,l = «1, «int,n mca3 = «n soat )' 

The derivatives J, S and d can be obtained from 
the curvilinear Jacobian and the transformation be- 
tween the local and curvilinear track parameters: 

d(K,a, u)j+i _ d{K,a, u)»+i 
d{K,a,u)i d(q/p,\,<fi,x±,y±) t+ i 
d(q/p, A, 0, x ± ,y ± ) i+1 d(q/p, A, <j>, x ± ,y ± ) l 
d(q/p,X,<j),xx,yx)i d(K,a,u)i 

The case of a constant magnetic field is described 
in [BJ. Solving for the slope correction yields: 

Aa« = S^CAm+i - J l Au l - d, Ak) (5) 

With a triplet of three adjacent offsets (u_, uo, u+) 
two slopes can be determined at Uo: 

a+ = W+(u+ - J + u - d + Ak), W + = S; 1 

a = W_(J_u -u_ + d_A/c),W_ = -SI 1 

(6) 

The difference P = a+ — a measures the change of 
direction due to multiple scattering at the central 
scatterer (u ): 

P = W+u+ - (W+J+ + W_J_)u + W u 

- (W + d + + W_d_)A K (7) 



u int = N(W+u+ + W_u_) 

- N(W+d+ + W_d_)A K (8) 

The interpolated offsets U; nti and the scattering an- 
gles Pi are predictions depending linear on the fit 
parameters q = (Ak,Ui, .., u„ scat ). Their expecta- 
tion values are the measured values from the ini- 
tial trajectory: P • (ui nt ^) = (residual to initial 
trajectory) and (Pi) = 0. P = ^ is the projec- 
tion matrix into the measurement system, where 
the covariance matrices V meas ^, are diagonal. The 
fit parameters are determined by minimizing: 

" scat — 1 

X 2 (q)= Yl &(qfV^(q) + 

i=2 

^mc as 

( m l - p 4 u mt, 4 (q)) T V m 1 asi (m J -P i u int , i (q)) 

i=l 

(9) 

The minimization leads to a linear equation sys- 
tem Aq = b of size n — n par . As all Uj ntii i depend 
only on two and all Pi on three adjacent offsets (and 
all on Ak), the matrix A is a bordered band matrix 
with border size 6=1 (curvature part) and band 
width m = 3 • dimension(u) — 1 = 5 (offset part): 
A-kl = for min(fc, I) > b and abs(fc — I) > m. 
This special structure of the matrix allows the us- 
age of the fast root-free Cholesky decomposition 
A u = LDL T of the band part of the matrix into a 
diagonal matrix D and a left unit triangular matrix 
L to obtain the solution with (D(n(m + b) 2 ) and the 
full covariance matrix with 0(n 2 (m+b)) operations 
(instead of simple inversion using 0(n 3 )). 

Millepede-II has been updated to check for each 
track fit the matrix A for a bordered band structure 
to benefit in this case from the fast solution by root- 
free Cholesky decomposition. 

4. CMS silicon tracker alignment 

Track-based alignment with Millepede-II and 
broken lines is one of the methods used for align- 
ment of the CMS silicon tracker. 
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For detailed alignment of the CMS silicon tracker 
consisting out of 16 588 modules several 10 4 param- 
eters are determined with Millepede-II using MEN- 
KES from millions of tracks. The Mille step for the 
creation of binary files is performed by many jobs 
in parallel, each processing different parts of the in- 
put data (tracks) in typically one hour. All binary 
files are processed by a single Pede step to fit the 
alignment parameters. The time spent for the solu- 
tion can be significant (many hours). The MINRES 
algorithm needs typically several hundred internal 
iterations and is therefore about a 100 faster than 
simple matrix inversion. The most time consuming 
part in MINRES is the product of a symmetric ma- 
trix and a vector of size n a ii gn . This has been paral- 
lelized with OpenMP™ [8\ to run Pede on multiple 
cpu cores. 

In the CMS tracking model measurement and 
multiple scattering happen at the same point: the 
silicon sensor layers (as thin scatterers). Therefore 
the number of scatterers is equal to the number of 
silicon layers (rt sca t = "-plane) and interpolation is 
trivial (u inM = Uj). 

For a constant axial magnetic field B = (0, 0, B z ) 
in the limit of small curvature the derivatives for 
the track propagation from scatterer i to i + 1 are 
simple functions of the arc-length s along the track: 

J= (o i)' s = Asi (o ?)' 

d = i(A Sl sintf) 2 Q (10) 

Here i9 is the angle between track and magnetic field 
direction and Asi — Sj_|_i — s,; = l/5i. The scatter- 
ing angles fii are in this case (similar to equations 
(4) and (7) in [4|) simply: 



Pi = (ui_i<5i_i - Ui(<Si_i + Si) + u i+1 Si) 

- |sini9 2 (Asi_i + As,) Q Ak (11) 

This is the first implementation of the broken 
lines model in three dimensions. The approximated 
diagonal forms of J and S lead to a reduced band 
width to = 4 providing an even faster track fit 
and due to fewer non-zero derivatives to smaller 
Millepede binary files. This implementation is now 
regularly used for CMS track-based alignment with 
Millepede-II. 



5. Results 

Equivalence of track models. The reference algo- 
rithm for tracking is the Kalman filter algorithm]?], 
a sequential track fitting algorithm stepping be- 
tween scatterers by adding measurements and pro- 
cess noise, without calculating the full covariance 
matrix. Equivalence is shown in figure [2] both from 
track fits (12 000 simulated "isolated muon" tracks). 
The correlation is good and no differences between 
the two fits are visible in the probability distribu- 
tions, even as a function of track parameters (mo- 
mentum, track angle, not shown here). 

Speed performance. The performance of the 
Cholesky decomposition was measured to be 7 
times faster than full inversion of the matrix in the 
track fit (subset of 250 000 cosmic tracks). 

Typical alignment of the full detector using 4.5 • 
10 6 tracks and solving for 57000 parameters takes 6 
hours (one node, up to 8 GB memory, solution step 
(Pede) only). Parallelization of some parts of the 
code (OpenMP™) improves speed on average by a 
factor of 3 (7 cores used). 

6. Conclusions 

The use of a suitable track model for alignment 
and its equivalence to the standard Kalman filter fit 
has been shown. A simple extension to Millepede-II 
(Cholesky decomposition for the internal track fit) 
allowed for performance optimization. Paralleliza- 
tion improves speed by a factor of 3. 
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Figure 2: Top: Correlation of \ 2 values of single tracks, 
comparing the broken lines fit with the Kalman filter fit. 
Bottom: Probability values of the x 2 values of single tracks. 
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